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ABSTRACT 



An investigation directed at finding the best low-order 
model which approximates a given high-order system is pre- 
sented. New insight is gained into the cost paid for the 
simplicity of the model and in the accuracy of the transient 
response of the model related to the magnitude of a cost 
function. 

The problem is solved in the time domain by finding the 
best pole and zero locations of the model which minimize a 
defined error criterion. The computer is used to estimate 
these parameters, via a parameter minimizating program. A 
number of examples are included. 
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I. 



INTRODUCTION 



The process of modeling a given system by a system of 
lower dynamic order can be applied in order to simplify 
systems prior to analysis or to simplify designs. The 
initial design of a complex system is more easily accom- 
plished if we can determinate a low-order model which 
approximates a high-order system and provides useful in- 
formation about the behavior and time-domain response of 
the system. 

Most works on control and simulation theory are per- 
formed on the basis that a mathematical model of the plant 
to be simulated or controlled is known, although this model 
often can be more complicated than is really necessary. 
Simplification of the model seems to be adequate and useful 
in such complex dynamic systems. In the stated problem the 
two major cases are: 

given 1. The measured time-domain transient response of 
a system to a known input driving function, 
or 2. The input-output relation — exact transfer 

function — or the describing set of differ- 
ential equations of a linear, constant system 
of order "n" 

find a linear, constant system of order "m" which best ap- 
proximates the given system. 

A number of mathematical methods and numerical tech- 
niques have been developed and proposed as an approach to 
the solution of the problem in specified and restricted 
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cases. All of them present radically different approaches 
but they can be divided into two main groups : one of them 
is to retain specified eigenvalues of the original system 
and to neglect those which do not contribute much to system 
response; the other is based on the estimation of a set of 
parameters of differential equations of specified order, 
the response of which approximates that of the original 
system when both have the same driving function as inputs. 

The approximation problem considered by Meier [6] uses 
a quadratic performance index, the mean-square difference 
between the output of the given system and the output of the 
reduced model when a random process is the driving function 
to both systems. Necessary conditions for optimum parameter 
values are calculated by differentiating the performance 
index with respect to the parameters. The approximated 
model is obtained for a specified or chosen suitable value 
of the order "m" . 

The Meier and Luenberger's approximation [5] deals with 
the modeling by a system of fixed lower order and leads to 
a set of nonlinear algebraic equations which constitute the 
set of necessary conditions for the optimal approximating 
transfer function which minimizes an integral criterion. 

Both methods require that the exact transfer function 
of the system must be specified and assume a stationary 
random process as input to exact and approximated systems. 

Kuppurajulu and Elangovan [4] propose a method for re- 
ducing a high-order system to a number of simplified models 
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by dividing the total time of response into a number of 
smaller intervals. The reduction is based on retaining 
only those eigenvalues of the system which have dominant 
effect during the time interval of interest. Thus reduced 
models can be obtained for the initial, intermediate and 
final stages of transient response. 

Davidson [8] , [9] and Chidambara [9] also propose a 

method based on the retention of specified eigenvalues of 
the original system and they neglect those which are far 
from the jw-axis since they make little contribution to 
the total response, except at the beginning. It uses rela- 
tionships from the time solution of the differential equa- 
tions of the original model in order to develop the reduced 
model. It is a projection method: a projection operator is 
found when the projection error is minimized and then, a 
contraction process is operated for choosing a suitable 
basis of dimension "m" (m<n) and a suitable set of "m" 
variables . 

Anderson's work is along the line of the second group, 
his method determines a reduced model by minimization of 
the mean-square error between the responses of both model 
and original system over a given interval. It uses the 
orthogonal projection theorem to minimize the sum of the 
square errors at the sampling instants, and the steady- 
state error between both responses is not forced to be zero. 

There are other transfer function methods, as the one 
of Chen and Shich which is based on the continued fraction 
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expansion in polynomial form of the transfer function, 
truncating it after a suitable number of terms. It takes 
into account the fact that the quotients in the expansion 
— by the final value theorem — are in order of decreasing 
contributions to the response as the steady state is 
approached . 

But in general, all these methods require an exact know- 
ledgment of the system transfer function and this requires 
that in practice we have to identify exactly the system in 
order to know its transfer function or the set of differ- 
ential equations which define it. Unfortunately this is 
seldom achieved. It seems more realistic to use directly 
the measured input-output data for the system and determine 
from it the reduced model for the system. 

Sinha and Pillie [1] present a method with this advan- 
tage based on the use of the matrix pseudoinverse to esti- 
mate the parameters of the model which minimize the Siam of 
the squares of the errors between the responses of the sys- 
tem and the model to a given input. It only requires the 
measurements of the input-output data. Sinha and Beraznai 
[3] develop a more general method for any specified error 
criteria of optimization, providing flexibility by the choice 
of the criterion and using pattern search for the optimum 
approximation. This method determines the optimum low-order 
model for a given order of the model (a model of order "m" 
is known, m<n) . 
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Fellows, Sinha and Wismatch [2] propose a simple method 
for reducing a high-order system to a second-order model. 

It selects the second-order model, that meets specified per- 
formance features of the step-response and which is a good 
approximation to the step-response of the actual system, 
based on the minimization of the integral of the square 
error criterion. 

As can be seen during recent years methods and techniques 

have been developed and applied to replace a complex system 

i 

by a simpler system, some of them choosing the modes to be 
discarded in the construction of the new low-order system 
by mathematical techniques and the other ones selecting the 

4- Vi 

order "m" (m<n) of the model and calculating the optimum nr" 
order system which best fits the original by different 
methods and criteria for the minimization process. 

In this thesis it is intended the search for the best 
model which fits the original by optimization in the time 
domain, or, if not, to answer the question of what will be 
the price which it is necessary to pay for the simplicity 
of the model if a previously selected order of the model is 
specified or desired. 

Carrying out an exhaustive search and determination of 
all possible low-order models for specific high-order sys- 
tems, hopefully seems feasible to provide a basis for com- 
parison of the results obtained if the complete set of 
resulting data is analyzed and studied in order to establish 
a criterion which can be used for the selection of the model 
in a particular problem. 
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Powerful mathematical tools of optimization theory and 
suitable criterion for an optimum fit in the solution are 
used in the practical search of low-order model systems. 

Two general cases are investigated: 

1. Modeling based on using directly the measured input- 
output data for the system. 

2. Modeling when the exact system transfer function is 
specified . 

In Chapter II of the thesis, a general description and the 
philosophy of the technique for the solution is given, and 
it is applied in Chapter III which is devoted to the study 
of four general examples selected as a guide for initializ- 
ing the investigation in this aspect of the modeling problem. 
This search can be thought of as another approach to the 
determination of low-order models and as an effort directed 
to extend the research done in this sense. 
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II. TECHNIQUE FOR SOLUTION 



A. GENERAL 

In dealing with the modeling of high-order systems by 
an optimum low-order model two main cases can be expected: 

1. The measured input-output data for the system is 
known . 

2. The exact system transfer function or vector dif- 
ferential equation are given. 

Some assumptions about the systems have to be made for 
the sake of convenience, although the same assumptions 
underline most of classical control. It is assumed that 
all systems are: linear, constant-coefficient, asymptotically 
stable and single-input and single output. Under these 
assumptions 

a. the linear system will be easier to study than the 
general case. 

b. a second-order system is clearly simpler than a 
fourth-order system. 

c. all poles of the system will lie in the left half 
plane . 

Also the optimum model system is that which minimizes the 
performance index previously selected. 

The dynamic behavior of a second-order system has been 
thoroughly studied and is well known, thus finding a pair 
of complex dominant roots --for the high-order system would 
be equivalent to approximating the system by a second-order 
model. It is known that in design problems of high-order 
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feedback systems by algebraic methods, the designer selects 
a pair of complex root locations and then tries to locate 
two of the roots of the system at these locations and the 
other ones (undesired roots) at remote points far from the 
jw-axis in the left-hand side of the s-plane. In this way 
the transient response of the system closely follows the 
selected second-order system's response. The "dominant" 
character is achieved if: 

a. the coefficients in the time response associated 
with the desired root are much larger than those associated 
with undesired roots. 

b. the time constants of the undesired roots are much 
smaller than those of the selected pair. 

For physical systems, closed-loop poles are seldom found 
at the origin and complex poles located far from the real 
axis produce oscillations in the time-domain response of a 
higher frequency than those located closer to the real axis. 

In this work it is assumed that the step-response of the 
high-order system has an overshoot at least. 

B. PHILOSOPHY OF APPROACH 

A realistic approach to the derivation of the low-order 
model which better approximates the given high-order system 
is to perform it directly from the known response of the 
system to a specified driven function which may be obtained 
experimentally. If the system is to be operated always with 
a specific input signal, then this driving function can also 
be used as input of the model for comparison of both 
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responses . A step function as driving function is very 
common in dynamic system test and identification procedures , 
on the other hand, step-function excitation often has the 
important advantage of simplicity. 

Thus, the problem can be restated as the determination 
of the transfer function of the low-order model which is an 
optimum approximation to the step-response of the actual 
high-order system, based on some criterion of goodness. 

It was felt that a convenient approach leading to the 
problem solution is the determination of the l ^* 1 optimum 
model (l<n) satisfying some specification of criterion 
rather than the determination of a specific low-order sys- 
tem, i.e. a second-order model. 

1 . Selecting the System Response 

A typical time characteristic, acceleration curve 
x out^ °f an actually existing dynamic element is shown in 
Fig. II. 1. In a general case an acceleration curve consists 
of a delay portion of duration t^, a concave portion a 

constant-velocity portion T 2 , a convex portion T 3 and the 
steady-state portion. 

Figure II. 2 shows typical unit-numerator step-response 
patterns for systems up to sixth order. 

If the step-response of a system takes the form 
shown in Fig. II. 3, it can often be approximated as a time 
delay plus the response of a second-order system with two 
complex roots. 
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Figure II. 1 




Figure II. 2. 
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x(t) 




time , t 

Figure III. 3. 



The common characteristic in the above step-responses 
is a time delay t^. Very often in the study of practical 
high-order systems, this concept of introducing a pure time 
delay to account for the higher order permits interpretation 
and study of the step response in terms of relative stability 
and the nature of the corresponding frequency response. 

Therefore, the high-order system response to a step 
input-function was selected as a pure time delay plus the 
response of a second-order system. The results in EXAMPLES 
I and II were obtained working with this assumed typical 
high-order system response. 

2 . Statement of the Problem 

Let the given n^-order linear, time invariant sys- 
tem be described by 
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x(t) = A x ( t) + B r(t) ; x_(0) = 0 

£(t) = C x ( t) (II .1) 

For the single-input case considered 
x(t) = A x(t) + B r(t) ; x(0) = 0 

y (t) = C x(t) (II. 2) 

where x(t) is the n-dimensional state vector and the "dot" 
over a variable is used to indicate the time derivative 
(d/dt) . A is a "n x n" matrix, B is an n-vector and r(t) 
is the scalar time function representing the input to the 
system (step-function) . C is the n-vector and y(t) is the 
output of the system. 

Consider a discrete set of values of y(t) taken over 
a suitable interval of time 

Y=’{y 0 , y 1 , y 2 , yi yt s ^ (n.3) 

y i = y(ti) 

which represents samples of the response of the system de- 
scribed by Eq. (II. 2) to a step-function input. It may have 
been obtained by a measuring instrument connected to the 
actual system output with a sampling interval sufficiently 
small in order that no information be lost. 

It is desired to find the best low-order model de- 
scribed by 

x = A r x r + B^. r ( t ) ; x r (0)=0 (II. 4) 

Yr = Cr x r 

whose set of output samples Y r satisfies the condition of 
minimizing an error function J (a) given by 
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J(a) = f (Yi ~ YrO 



(II. 5) 



where a represents the N c ~vector of the free model parameters. 
3 . Error Function Criteria 

The mean-square criterion was chosen as the function 
of the errors (yf~y r f) • This performance index is suitable 
for many minimization problems and takes the form 

n f 

J(a) = 2 Wi (yi - y ri ) 2 (II. 6) 

o 

where nf is a positive integer defined as 

final time of the calculations tf 

n f (II. 7) 

sampling period T 

and w^ is a weighting sequence which for the single-output 
case — assumed in this work — is unity. 

When (J) is minimized with respect to the free low- 
order model parameters in the bounded region defined by the 
constraints, the optimum values of the free parameters are 
found. Since one free parameter exactly locates one root 
of the model, when the error criteria is minimized the set 
of optimum parameters locate all the roots and the transfer 
function of the optimum model is determined. 

The error criterion in the form 



J(a) 




(Yi 



y r i> 2dt 



(II . 8) 



depends on tf, but once tf is chosen long enough and fixed, 
it does not affect the optimum parameter values obtained at 
the end of the minimization process. tf was chosen as the 
settling time of the time-domain response of the high-order 
system. 
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C. METHOD OF SEARCH FOR BEST MODEL 



1 . Philosphy 

The problem of approximating the high-order system 
by a low-order model in an optimum manner was solved for the 
specified error criterion (see Chapter (II. B. 3)). 

For the general ith-model (Eq. II. 4) the closed loop 
transfer function can be written as 



Y r (s) b m s m + b^-LS™ -1 + + bj_ s + b Q 

G r (s) (II. 9) 

R(s) s ^ + + a-^ s + aQ 



or 



K(s+zi) (s+z 2 ) (s+z m ) 

G r (s) — (II. 10) 

(s+p-l) (s+p 2 ) (s+p £ ) 

which is a function of the transfer gain and pole-zero con- 
figuration, which are the free parameters of the model. 

Assume a - complex system presenting a step-response 
which may have an overshoot. Then Eq. (II. 10) may be 
modified 



K (S + Z]) (s+z 9 ) ( S + Zrn) 

G r (s) 

(s 2 +2a^a 2 s+a|) (s+p 2 ) .... (s+p£) 

where 



(II. 11) 



Pl+P 2 = 2a x a 2 
PlP 2 = a 2 

and p^>0 (no pole at origin) 

This low-order model is characterized and defined by 
a set of free independent parameters which can be chosen 
based on a specified error function criterion in order to 
optimize it. For given values of the pair "1" and "m" 
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(m>l>n) the optimum l^-order model which minimizes the 
error criteria is realized by an optimum choice of the free 
parameters. It is reasonable to expect the value of the 
error criteria between the responses of the actual system 
and the model, for each one of them, will decrease as the 
order of the model is increased. If a 3-dimensional param- 
eter space is considered with coordinates axis 
XX' : number of zeros of the model- 
Y Y ' : number of poles of the model 

ZZ' : values of the error criteria for optimum model 
for a specific value of the transfer gain, the set of error 
criteria values for the multiples choices of both number of 
zeros and poles will be represented by a surface. Hopefully 
a minimum to this surface, if it exists, would represent the 
minimum of all minimum error values , in other words , it 
would define the "best" of all optimum low-order models for 
a specific value of the transfer gain. 

The decision in the choice of the lower order ap- 
proximated model which better represents the given system, 
if there is not a net minimum, can be done taking into 
account available criterion such as: limitations on the 
maximum order of the model because the limitations on the 
available model components, or sufficiency of the resultant 
error criterion (J) which satisfies the inequality 
J - > 0 

where is a minimum boundary — decision criterion — for 
the error criteria (J) . In this way, having plotted the 
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error criteria versus a specified number of poles and zeros 
it will be easy to decide which model accomplishes the de- 
cision criterion or which one is the best among all the low- 
order models not satisfying it. 

Starting with a model with poles only (no zeros) the 
optimum set of parameters can be determined for the second- 
order model satisfying the selected error criteria, the 
order is then increased by one and a third-order model is 
determined in the same way, and so on. Plotting the results 
will show the variations of the error value with respect 
to the order of optimum models. Continuing with a model with 
one zero, the same search is performed increasing the number 
of poles by one. Then select models with two, three,., 
zeros and for all of them, again, the optimum models with 
increasing number of poles are determined. The family of 
curves obtained are the major decision tool in the deter- 
mination of the optimum low-order models. 

2 . Constraints 

In order to get the optimum low-order system's trans- 
fer function it is necessary to find the optimum value of 
the transfer function gain, K, and the best locations of 
zeros and poles for the optimum model. Thus the number of 
free independent parameters at least is equal to m+SL+1, 
where 

m : number of zeros of the model 
1 : number of poles of the model 
K : transfer function gain 



21 



As was stated in paragraph II. B. 4, a 3-dimension 
parameter space is considered for representing the varia- 
tions of the error criteria as a function of both number 
of zeros and poles. 

In setting up constraints on the minimization process 
the transfer function gain may be kept constant or it may be 
allowed to vary as one of the parameters. If it is variable 
then a 4-dimensional space is needed. This not only makes 
it hard to find the minimum of the surface, but the concept 
of a varying gain is not consistent with most physical 
problems — at least not for control systems. Therefore in 
this study the gain is kept constant . 

In practical systems the Body gain, i.e., the trans- 
fer function gain when written in Bode form, usually is 
fixed by specifications. In many applications it corre- 
sponds to the DC gain or zero frequency gain. If the 
transfer function is left in Root Locus form, i.e. (s+z)/ 
(s+p) , the Root Locus gain is a number that varies with 
both the number of zeros and poles, and as such does not 
usually have an apparent relationship with physical system 
performance characteristics. 

Therefore the Body gain is kept constant in the 
search for the minimum, and it is also constrained to be 
positive . 

In order to ensure the stability of the system the 
pole and zero location is restricted to the Left Hand Plane 
only, assuming no poles at origin. 
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3 . Minimization in Parameter Space 



The error criterion or performance index is minimized 
with respect to the free system parameters in the bounded 
parameter space defined by upper and lower boundaries on the 
parameter values and by the constraining inequalities and/or 
equations. When this is done it yields the best zero and 
pole locations for the given lower order model. 

Various search techniques may be considered for the 
minimization process of the specific error criteria. Gradi- 
ent methods are quite efficient in locating a minimum, 
although the necessity of calculating partial derivatives 
of arbitrary error criteria with respect to all the free 
parameters seems to be a disadvantage. Direct search in- 
volves evaluating the effect of sequential parameter changes 
in an organized manner. 

A subroutine for the minimization of an arbitrary 
function by the complex method of M. J. Box [14] was chosen 
as a suitable method for this work. 

An important problem associated with every search 
technique is the selection of the starting parameter values, 
because of their considerable influence on the convergence 
of the process and on the probability of locating the 
optimum minimum. If the step-response of the high-order 
system has an overshoot it is felt that the determination 
of a second-order system with a pair of conjugate poles 
(dominant roots) will be a good approach for the selection 
of the starting parameter values. From the step-response 
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some features usually can be specified: the maximum over- 
shoot, the steady-state response, the settling time, the 
time to reach the first maximum; therefore, a second-order 
system that meets those specification approximately can be 
determined using the analytical expressions or the universal 
curves for the step-response as a function of the natural 
frequency (w n ) and the damping ratio (£) . These approximate 
parameter values are used as starting values for the minimi- 
zation program in order to get the optimum set of parameters 
for the second-order model and successive higher order 
models . 

For the case in which the step-response has no over- 
shoot a simple first order system can be determined by 

K 

G (s) 

s+p 

p = 1/t , x = time required to reach 0.632A. 

K = A.p , A = steady-state response to unit step, 
for the selection of the starting parameter values in the 
minimization subroutine. 

This thesis considers only step-response with an 
overshoot (more general case for physical systems) . 

D. PROGRAMMING 

The performance index (error criteria) is minimized with 
respect to the free system parameters. 

A subroutine has been used which finds the minimum in 
the given bounded region. 
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At each of the minimization procedure, Eqs . (II. 4) and 
(II. 8) are integrated from t=0 to t=t^ by using a fourth- 
order Runge-Kutta method.'*' The optimum parameter and mini- 
mum error values are taken back to the main program which 
calls another subroutine (SIMUL) for the digital simulation 
of both high-order and low-order systems in order to get a 
graph representation of the time-domain responses and com- 
pare them. 

If at the end of a minimization step the calculated 
parameters, or at least one of them, are on the limiting 
boundaries then the limiting boundary (s) can be relaxed and 
the minimization should be repeated again to obtain optimum 
parameter values for the new boundaries. 

The original high-order system may be specified either 
by its output response to a given input step-function avail- 
able at discrete uniform intervals of time, or by the closed 
loop transfer function. In the latter case the main program 
computes the transient response at discrete uniform interval 
stores it in an array "look-up" and the computation con- 
tinues as in the first case. 

The parameter starting values for the model to be used 
in the minimization program have to be given by the user. 

A computational flow chart is shown in Fig. II. 4. 



•^The increment time for the integration process should 
be equal to the sampling or integration times for the given 
high-order system. 
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INPUT : 

Input-output measured 
data of the system. 
N: number of samples. 
DT : sampling interval 



I 

I 



I INPUT : “7 ~1 

State equations of 
the system. 

N: number of points. . 
DT : integration interval.! 





Explicit constraints on the 
independent variables. 
Upper and lower bounds . 
Starting point. 



£ 









SUBROUTINE BOXPLX : Finds the 
minimum in the given bounded 
region . 

("Continue with! (Generate 
| the normal I | another | 
jminimization | yooint | 

■ — 1 

NO $ES 



FUNCTION KE (X) : 
Checks for specific 
constraints imposed 
by the user. 

If o.k. , set KE=0 
Otherwise set KE=-1 



FUNCTION FE (X ,XDATA) : 
Calculates the value of 
the error criterion (J), 



A minimum is found 
PRINT: a and the value of 
the other necessary variables 



Are the free parameters on the 




Relax 


the 


preset upper and/or lower 


YES 


boundaries . 


boundaries? 









NO 



PRINT: "The optimum 
model is : " , 

and a, J, other necessary 
information . 







.7 



V 



Set the new starting 
point at a_. 



(go to A ) 



Figure II. 4. Computational flow-chart. 
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Two computer programs which are written in Fortran IV, 
and used for two specific models of the Examples I and IV 
are given at the end of the thesis. 
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III. INVESTIGATION AND DERIVATION OF MODELS USING MEASURED 



' INPUT -OUTPUT DATA FOR THE SYSTEM 



A. GENERAL 

It was felt that a convenient description of the actual 
high-order system measured input-output data has the form 
shown in Fig. II. 3, namely a pure time delay plus the re- 
sponse of a second-order system. In this way the output of 
the system is obtained and sampled at suitable time interval 
(At) . 

The next step is interpreting the features of the step 
response more commonly specified, in order to select the 
starting parameters for the search of the model (as was 
indicated in Chapter II. 3). Then the state equations of 
the possible model are integrated with respect to time with 
a step-input function, and the output of the model is ob- 
tained and sampled at At. These samples are compared with 
the values of the response of the system. An error criteria, 
which measures the deviation of the sampled model values 
from the sampled system values (from zero time to the selected 
settling time of the system) is defined. Minimization of this 
error criterion with respect to the model parameters yields 
the optimum model, for the given system description, using 
a specific order for the model. 

The starting parameter values were taken as is stated 
in Chapter II, Section C.3. 
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B . EXAMPLE I 



The input-output measured data for the testing system 
was taken as the step-response of a second-order system 
with 

C = 0.316 

w n = (10.)^ (poles at: -1. + j3) (III.l) 

K = 10. 

delayed an interval t^ = 0.15 seconds. 

This response was computed by digital simulation from 
0 to 5.2 seconds and 520 samples of this response (at inter- 
vals of 0.01 seconds) were used for the determination of 

4 - , » . » 

optimum l u -order models by minimization of the error 
criterion (Section II. B). 

The investigation of possible models was carried out 
starting with l^-order models (1 = 2, 3,.... 7) with no 
zeros, and then repeating the search for models with one 
zero, then with two zeros, ending with models with three 
zeros. It is considered that 7 poles and 3 zeros are a 
good stop criterion for analyzing results. 

As a constraint it is assumed that there is no error 
in steady-state response to a step input, keeping the Bode 
gain constant. 

1 . Two Poles No Zeros Model 
a. Model response 

The state equations of the second-order model 
can be written as 
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u(t) 



X r (t) = 



0 1 


•x (t) + 


0 


-PlP 2 “ ( Pl + P2 ) 


— T 


1 



x r (0)=0 



(III. 2) 



where u(t) = 'Ji(t) , x r (t) is the state vector of the model 



= l(t) , 

and P 1 /P 2 are the pole locations or free parameters of the 
model . 

The output of the model is 
£ r (t) = [ K °] * x r (t) (III. 3) 

where K is the transfer gain. 

Calling a the N c -dimensional vector representing 
the free model parameters (where N c =number of poles + number 
of zeros) , the state equations can be rewritten as 



x_(t) = 



0 


1 


X 1 


O 

L. 






• + 




„“ a 2 


- 2 a^a 2 


x 2 


1 

J 



u(t) 



(in. 4) 



because they are chosen as parameters and 012 — the 
damping ratio and natural frequency, 
b. Constraints 

The only constraining equalities and inequalities 



are 



3 

K/c^ = constant = 1. 



0<a^<0 . 5 
0<a 2 <5 . 5 

as a boundary for the dynamic response. 

c. Result of the minimization 

The error criterion is written as 



(III. 5) 



J(a) = Xj(t f ) 



- r 

JO 



f [y (t) - y ( t) ] 2 



' dt 



(III. 6) 
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where t^ = final time of the sampled complex system. 

And its time derivative is 
Xj(t) = [y ( t) - y r (t) ] 2 (III. 7) 

The integration is performed with increment time 
At = sampling interval = 0.01 seconds. 

The performance index Xj(a,t) is minimized by 
the computer subroutine with respect to the free parameters; 
the optimum parameter values and error criterion minimum 
value are tabulated in Table III.l, and the optimum time 
response of both the original and optimum second-order 
system (for a unit step input) are plotted in Fig. III. 5. 

2 . Three Poles and no Zeros Model 

a. In all this work it was assumed that the de- 
sired dynamic response of the model was represented by two 
complex roots and a certain number of real poles and zeros 
(because of the overshoot of the original system) . Thus 
for this case the model transfer function 
Y r (s) K 

G r (s) (III. 8) 

U(s) (s+pj) (s+p 2 ) (s+p 3 ) 

can be written as 



K 



G r (s) = 



2 2 
(s + 2 a^a 2 S+a 2 ) (s+a 3 ) 



(III .9) 



where the free system parameters vector a is represented by 



a = 



and 



each a i = f (p- L #p 2 ,P 3 ) . 
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The state equations for the model are written in the 



form 





r ° 


1 


0 ” 




0 


11 


0 


0 


1 


•x r (t) + 


0 




L ai 


~ a 2 


" a 3_ 




1 


and the output of the 


model 


is 






rr 

II 


j~K 0 ( 


jj • X 


r (t) 


; x r (0) = 


0 



u(t) (III. 10) 



(III. 11) 

where each a^ = f (a-^ , 013 ) and K is the transfer gain. 

b. In setting constraints, again the Bode gain was 
kept constant and no error was permitted in steady-state 
response to a step input 
K 



2 

a a 
2 3 



= 1 . 



(III. 12) 



The third pole ( 013 ) was constrained to an upper 
bound of 100 and to be positive; flexibility was given in 
the computer program for changing this constraint if the 
upper boundary was reached. The minimization process 
showed that the boundary was not reached. The complex 
conjugate poles were constrained as in Section III.B.l. 

Minimization of the objective function (J) yields 
as optimum parameter values the result tabulated in Table 
III.l and plotted in Fig. III.l. Figure III . 6 shows the 
time responses _ of both the system and the desired third- 
order model with no zeros. 

3 . More Than Three Poles and No Zeros Models 

With the assumption of two complex conjugated roots 
for the model and following the same technique, search and 
determination of optimum models of order ranging from fourth 
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to seventh was carried out. The resulting optimum param- 
eters and optimum error criteria are tabulated in Table 
111.1/ and the minimum error criterion value is plotted 
versus number of poles in Fig. III.l. 

4 . Models With Zeros 

The number of zeros of the model was increased by 
one and determination of the l^-order model (2<&<7) was 
investigated . 

The state equations of the l^-order system are 
written in the form 

^ (t) = Aj.Xj.Ct) + B r u(t) ; x r (0) = 0 (III. 13) 



where 



0 

0 



£r = 



-a l 





and the output of the model is 




(III . 14) 



Zr (t) = £r*r (t) 

where 



(III. 15) 



Cj. = K [h 1 b 2 b m ] (III. 16) 

In the same way as in section (2. a) the coefficients a^ and 
b^ are functions of the free parameters (poles and zeros) of 
the model system. They are expressed as the sum of com- 
binations of products of the free parameters. 
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Each model was minimized with respect to the selected 
error criterion (Eq. (III. 6)). The final time for the inte- 
gration is taken as the final time sampled (t£=5.2 seconds). 

Again the starting parameter values were taken from 
the second order model and the boundaries from the same model 
with no zeros. Flexibility was given for changing the upper 
and lower bounds if any of them was reached and the result 
was a constrained minimum. Constant Bode gain and zero error 
between both steady-state responses were required. 

The resulting free parameter values for each optimum 
model are tabulated in Tables III. 2, III. 3 and III. 4 (and 
the corresponding error criterion values) . A plot of the 
cost function (J) versus the number of poles, for constant 
number of zeros, is showed in Figs. III. 2, III. 3 and III. 4. 

Table III. 5 is a comparison of the error criterion 
values for all models studied in this example and it shows 
the existance of a best-optimum low-order model. Figs. III. 7 
to III. 18 show the time response of the system and several 
models . 

5 . Remarks 

Looking at the tabulated results in Table III. 5, 
which is a resume of the study done with this system and a 
clear basis of comparison between all the models, and at 
the plotted values of the performance index (J) versus 
number of poles, some facts can be clearly pointed out: 
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# Of 
Poles 


2 


3 


4 


5 


6 


7 


K 


. 35 


.288 


.297 


.303 


. 309 


.31 


W N 


2.734 


3.145 


3.148 


3.148 


3.138 


3.137 


P3 




6.24 


7 . 8 


9.35 


13.46 


14.25 


... P4 






37.1 


29.7 


25.4 


24.98 


P5 








87.24. 


41.57 


69. 


P6 










111.9 


87.7 


P7 












98.74 


JxlO 4 


131. 


5.17 


4.7 


5.09 


6.09 


6.4 



TABLE III.l. EXAMPLE I. Optimum models without zeros 



# Of 
Poles 


2 


3 


4 


5 


6 


7 


S 


.351 


.25 


.296 


.301 


. 302 


. 303 


W N 


2 . 72 


2.99 


3.15 


3.147 


3.141 


3.144 


P 3 




2.69 


8.46 


8.2 


8.64 


8.2 


P4 






12 . 84 


9.22 


10.34 


15.57 


P5 








22 . 36 


37.4 


38.72 


P6 










87.1 


61.66 


P7 












91.75 


_ Z 1 


199 . 8 


5. 


25.1 


8.14 


10.1 


11.4 


JxlO 4 


140. 


36 . 


4.4 


4 . 8 


5 . 


5.4 



TABLE III. 2. EXAMPLE I. Optimum models with one zero 
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# of 
Poles 


3 


4 


5 


6 


7 


6 


.274 


.29 


.294 


.298 


.296 


W N 


3.126 


3.147 


3.149 


3.145 


3.149 


P7 


4.96 


8.46 


7.595 


9.67 


7.4 


P 4 




9.52 


14 . 327 


10.086 


15.44 


Ps 






20.428 


48.778 


35.34 


P6 








53 . 34 


65 . 55 


P7 










105.6 


Z 1 


34.76 


28.13 


18.11 


14.68 


14.55 


z 2 


148.9 


33.57 


26 . 7 


49 . 55 


36.13 


JxlO 4 


8.4 


4.5 


4.5 


4.61 


4.8 



TABLE III.3: • EXAMPLE I. Optimum models with two zeros. 



# of 
Poles 


4 


5 


6 


7 


K 


.295 


.281 


.295 


.297 


w N 


3.152 


3.139 


3.151 


3.003 


P3 


9.7 


6.67 


9.372 


0.014 


P 4 


10 . 87 


8.6 


10.104 


20.78 


P5 




153.9 


43.54 


25.76 


P6 






120.91 


47.52 


P7 








82.91 


Z 1 


49 . 8 


20.19 


19 . 


0.013 


z 2 


98.78 


23.7 


62.45 


17.032 


- z 7 


116.58 


53.76 


82 . 86 


26.348 


JxlO 4 


4 . 24 


4.402 


4.406 


4 .47 



TABLE III. 4. EXAMPLE I. Optimum models with three 

zeros . 
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Number of Poles Number of Poles 



JxlO 4 



JxlO 4 




Number of Poles 



Figure III. 3. 




Figure III. 4. 



38 



OUTPUT 




Figure III. 5. EXAMPLE I. System's response (A) and the Two 

Poles no Zero model's response 
(B) to a unit step input. 



39 




Figure III. 6. EXAMPLE I. System's response (A) and the 

Three Poles no Zero model's re- 
sponse (B) to a unit step input. 
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Figure III. 7. EXAMPLE I. System's response (A) and the Four 

Poles no Zero model's response (B) 
to a unit step input. 
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to a unit step input. 
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Figure III. 9. EXAMPLE I. System's response (A) and the Six 

Poles no Zero model's response (B) 
to a unit step input. 
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Figure III. 10. EXAMPLE. I. System's response (A) and the 

Three Poles and One Zero model's 
response (B) to a unit step input. 
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Figure III. 11. EXAMPLE I. System's response (A) and the 

Four Poles and One Zero model's 
response (B) to a unit step 
input . 
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response (B) to a unit step 
input . 
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response (B) to a unit step 
input . 
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response (B) to a unit step 
input. 
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Four Poles and Two Zeros model ' s 
response (B) to a unit step 
input . 
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input . 
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Figure III. 17. EXAMPLE I. System's response (A) and the 

Five Poles and Three Zeros 
model's response (B) to a unit 
step input. 



51 





« 

0. 1. 2. 3. 4. 5. 6. 

Figure III. 18. EXAMPLE I. System's response (A) and the 



Seven Poles and Three Zeros 
model's response (B) to a unit 
step input. 
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a. A best optimum model seems feasible. 

b. The models in the range from four poles to seven 
poles achieve a very acceptable error criterion value. 

c. The second-order model does not seem a very good 
approximation . 

d. The simplicity of a specific order model can be 
weighted versus criterion error value. 

e. As the order of the model is increased the poles 
go far away on the real axis. On the other hand the error 
criterion value remains almost unchangeable increasing the 
order. Thus it can be thought that adding poles to the 
model is not going to minimize the performance index. 



\Poles 

Zeros'v. 


1 


2 


3 


4 


5 


6 


7 


0 




131. 


5.17 


4.7 


5.09 


6.09 


6.4 


1 




140. 


36 . 


4.4 


4.8 


5.0 


5.4 


2 






8.4 


4.5 


4.5 


4.61 


4 . 8 


3 








4.24 


4.402 


4.406 


4.47 



TABLE III. 5. Error criterion (JxlO^) for models in 
Example I . 



C. EXAMPLE II 

The input-output measured data of' the high-order system 
was taken as the step-response of a second-order system with 
the same features (Eq. (III.l)) as in Example I, delayed an 
interval approximately twice the above t^. Thus, now 
t^ = 2ta = 0.3 seconds. 
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536 samples of the input-output assumed response (at in- 
tervals of 0.01 sec.) were used as measured data for the 
derivation of the l^-order optimum models by minimization 
of the performance index defined in Eq. (III. 6) . 

The investigation was performed using the technique of 
Example I. All possible models were determined of order 
ranging from no zeros and two poles to seven poles and three 

'i 

zeros. The optimum pole and zero locations obtained for 
each model are tabulated in Tables III. 6 to III. 9 and plots 
of the error criteria values versus number of poles are 
shown in Figs. III. 19 and III. 20 for specific numbers of 
zeros . 

For further comparison between all models Table III. 10 
shows the performance index (error criteria) values for 
each. Figs. III. 21 to III. 36 show the time responses of 
various models and the original system. 

1 . Remarks 

The following comments should be noted: 

a. If l>k the results show that the optimal model 
of order "1" is better than the optimal model of order ‘"k". 
The error criterion value decrease as the order of the 
model increases, although in any cases the error values 
for the fourth-order model (no zeros) and higher can be 
considered acceptable. 

b. For a specific number of poles, adding a zero 
to the model maintains the cost function value at about the 
same magnitude. 
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# of 
Poles 


2 


3 


4 


5 


6 


7 


C 


. 405 


.228 


.255 


.266 


.275 


.282 


W N 


2.34 


2.995 


3.136 


3.145 


3.156 


3.16 


P3 




2.93 


5.94 


6.59 


7.51 


10.17 


P4 






5.896 


6.73 


11.03 


9.67 


P5 








30.9 


10. 


10.52 


P6 










174.91 


68.89 


P7 












70 . 33 


JxlO 4 


490 . 


63.6 


18.5 


12.6 


8.2 


6.3 



TABLE III. 6. EXAMPLE II. Optimum models with no zeros 



# of 
Poles 


2 


3 


4 


5 


6 


7 


S 


.407 


.227 


.252 


.252 


.274 


.285 


w N 


2 . 328 


2.988 


3.13 


3.123 


3.156 


3.158 


P 3 




2 . 885 


5.62 


5.69 


8.38 


10 . 7 


P 4 






5.81 


5.73 


8. 86 


10.97 


P 5 








30.01 


10.02 


11.06 


P6 










132 . 86 


20.01 


P 7 












159 . 55 


Z 1 


199 . 8 


219 . 35 


97 . 88 


21.98 


89 . 37 


117.12 


JxlO 4 


500 . 


66.8 


21.1 


13.2 


8.7 


5 . 8 



TABLE III. 7. EXAMPLE II. Optimum models with one zero 
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# of 
Poles 


_3 


4 


5 ... 


6 


. 7 


C 


.222 


.246 


.257 


.274 


.277 


w N 


2.965 


3.105 


3.13 


3.154 


3.154 


P3 


2.75 


5.13 


5.14 


6.96 


7.03 


P4 




5.69 


10.37 


9.998 


11.17 


P5 






12.64 


13.77 


13.4 8 


P6 








29 . 8 


28.8 


P7 










101.97 


Z 1 


64.98 


57.85 


40.2 


88.64 


61.9 


z 2 


199 . 38 


75.6 


149 . 5 


102.87 


163.5 


Jxl04j 


78 . 


26.9 


15.4 


8.4 


7.9 



TABLE III. 8. EXAMPLE II. Optimum models with two zeros. 



# of 
Poles 


4 


5 


6 


7 


6 


.244 


.258 


.271 




w N 


3.103 


3.13 


3.15 




P3 


5.064 


5.53 


9.001 




P4 


5.514 


7.73 


9 . 




P5 




12.78 


9.011 




P6 






20. 




Z 1 


49.12 


38.52 


27.65 




z 2 


110.57 


50.54 


76.84 




z 3 


119 . 32 


191.07 


175 . 3 














JxlO 4 


29.1 


17.3 


9.3 


7.9 



TABLE III. 9. EXAMPLE II. Optimum models with three zeros. 
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Number of Poles Number of Poles 

Figure III. 19. 
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Number of Poles Number of Poles 



c. Between one model and the next one (increasing 
the order by adding a pole) the additional pole does not 
affect the initial pole location appreciably. They remain 
approximately the same, and the new pole is set far away to 
the left (in the s-plane) . 

d. The second-order model is the worst. 

e. Selection of the desired model can be done 
easily depending on the desired simplicity, looking at the 
transients responses of both (original and approximated) 
systems and with a little margin for the cost function 
value it can be seen, in this example, that the fourth-order 
model fits very well. 

f. The complex root values for the various models 
remain in a very small area, i.e., their values are 
essentially unchanged by the addition of poles and zeros. 



^•vPoles 

ZerosS. 


1 


2 


3 


4 


5 


6 


7 


0 




490. 


63.6 


18.5 


12.6 


8.2 


6.3 


1 




500 . 


66.8 


21.1 


13.2 


8.7 


5.8 


2 






78. 


26.9 


15.4 


8.4 


7.9 


* 

3 








29.1 


17 . 


9.3 


7.9 


TABLE III 


.10. 


Error 


criterion (JxlO^ 


b for : 


models 


in 



Example II. 



D. EXAMPLE III 
1 . General 

A transfer function G(s) of a seventh-order system 
with no finite zeros is given by 
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Figure III. 21. EXAMPLE II. System's response (A) and the 

Two Poles no Zero model 1 s re- 
sponse (B) to a unit step input. 
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Figure III. 22. EXAMPLE II. System's response (A) and the 

Three Poles no Zero model's 
response (B) to a unit step 
input. 
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Figure III. 23. EXAMPLE II. System's response (A) and the 

Four Poles no Zero model's 
response (B) to a unit step 
input . 
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Figure III. 24. EXAMPLE II. System's response (A) and the 

Five Poles no Zero model's 
response (B) to a unit step 
input . 
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Figure III. 25. EXAMPLE II. System's response (A) and the 

Seven Poles no Zero model ' s 
response (B) to a unit step 
input . 
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Figure III. 26. EXAMPLE II. System's response (A) and the 

Three Poles and One Zero model's 
response (B) to a unit step 
input . 
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Figure III. 27. EXAMPLE II. System's response (A) and the 

Four Poles and One Zero model's 
response (B) to a unit step 
input . 
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0. 1. 2. 3. 4. 5. 6. 

Figure III. 28. EXAMPLE II. System's response (A) and the 



Five Poles and One Zero model's 
response (B) to a unit step 
input . 
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Figure III. 29. EXAMPLE II. System's response (A) and the 

Six Poles and One Zero model 1 s 
response (B) to a unit step 
input. 
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Figure III. 30. EXAMPLE II. System's response (A) and the 

Seven Poles and One Zero model's 
response (B) to a unit step 
input. 
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0. 1. -2. 3. 4. 5. 6. 

Figure III. 31. EXAMPLE II. System's response (A) and the 

Four Poles and Two Zeros model's 
response (B) to a unit step 
input . 
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Figure III. 32. EXAMPLE II. System's response (A) and the 

Six Poles and Two Zeros model's 
response (B) to a unit step 
input . 
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Figure III. 33. EXAMPLE II. System's response (A) and the 

Seven Poles and Two Zeros 
model's response (B) to a unit 
step input. 
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0. 1. 2. 3. 4. 5. 6. 



Figure III. 34. EXAMPLE II. System's response (A) and the 

Four Poles and Three Zeros 
model's response (B) to a unit 
step input. 
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Figure III. 35. EXAMPLE II. System's response (A) and the 

Five Poles and Three Zeros 
model's response (B) to a unit 
step input. 



74 





Figure III. 36. EXAMPLE II. System's response (A) and the 

Six Poles and Three Zeros 
model's response (B) to a 
unit step input. 
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384 x 10 7 

G ( s ) 

s 7 +432s^+626 70s 5 + 36159 00s 4 +75114000s 3 + 5539 20000s 2 . . . 

. .+1443200000s+384xl0 7 (III. 17) 

or in factorized form 

384 x 10 7 

G (s) (III. 18) 

( s 2 +2s+10) (s+10) ( s+20 ) (s+80) (s+120) (s+200) 

The response of this system to a unit step was com- 
puted from 0 to 8.4 seconds and 700 samples of this response 
(at intervals of 0.012 seconds) were used for the determina- 

i T_ 

tion of optimum l 1 " -order models by minimizing the objective 
function specified in Chapter II. B. 3. 

It was decided to obtain all the low-order models of 
the seventh-order system described by Eq . (III. 17) following 
the same technique as Examples I and II. First obtaining a 
second-order model with no zeros. Having found the optimum 
parameters using the computer programme, the order is then 
increased by one and a new model is selected and determined. 
When the sixth-order model is determined the number of zeros 
is also increased by one and new models are found. In this 
way the search is completed when the six poles and three 
zeros model is determined. 

The main features of the step response are given 



below : 

Time to reach first overshoot 1.18 seconds 

Maximum overshoot 30% 

Steady-state value 1 

Initial slope 0 
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Response at maximum overshoot 1.33 

Rise time 0.7 seconds 

2 . The Model Response 



The desired model response was represented by two 
dominant complex conjugated roots and a number of real poles 
depending on the model's order. 

From the curves of the step-response of a second 
order system with no finite zeros and the above features, 
starting parameters for the second order-model were selected 
as : 

c*! = C = 0.3 

a 2 = w n = 3.5 

and tf = 8.4 seconds. In the same way using the universal 
curves of the second-order linear system step response 
characteristic, reasonable bounds were chosen as: 

0 . Ka^O . 55 

(III. 19) 

1 . 5<a2^6 . 

in order to set constraints on the free parameters (a^o^) 
for the determination of the second-order model, which will 
be starting parameter values (Chapter II. C) of the increasing 
order models. 

The state equations of the system are written 
directly from Eq. (III. 17). 

The error criterion defined by Eq. (III. 18) is 
minimized by the computer subroutine. 
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3. The Second-Order Model 



The state equations can be written as Eq. (III. 4). 

The Bode gain was kept constant with no steady- 
state error between both responses (system and model) . 

Constraints were set on the free parameters as 
indicated in inequalities (III. 19). 

The optimum parameter values and minimum error 
criterion are tabulated in Table III. 11, and the Fig. 

III. 37 shows a plot of the error criterion (J) value. 

4 . Models 

As was done in Examples I and II, all the different 
order models ranging from the two poles and no zero to the 
six poles and three zero were determined. 

Also as a basis of comparison, the seven poles no 
zeros model was determined; the optimum parameter values 
for this model are very close to the real parameter values 
of the seventh-order test system, and the value of the 
performance index (J) is the smallest of all (really it 
would be zero but for the limitations on computer accuracy) . 

In Tables III. 11 to III. 14 are shown the different 
sets of free parameter values for each of the optimum 
specific-order models and the corresponding error criterion 
values . 

Plots showing the variation of J versus the number 
of poles of the model are given in Figs. III. 37 and III. 38. 

In order to get a basis of comparison between models 
and resultant values of the cost, function (J) for all of 
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TABLE III. 11. EXAMPLE III. Optimum models with no zeros. 
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TABLE ill. 12. EXAMPLE III. Optimum models with one zero. 
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TABLE I II. 13. EXAMPLE III. Optimum models with two 

zeros . 
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TABLE III. 14. EXAMPLE III. Optimum model with 

three zeros. 
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Figure III. 38. 
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TABLE III. 15. Error criterion (JxlO^) for models 

in Example III; 
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them are tabulated in Table III. 15. Figures III. 39 to 
III. 49 show the transient responses of both the system and 
the reduced model for different pole and zero values. 

5 . Remarks 

Some facts can be pointed out looking at Tables 
III. 11 to III. 15 and at Figs. III. 37 and III. 38, such as: 

a. The second-order models (no zero and one zero) 
do not appear to be suitable. 

b. A model which gives a minimum value of the 
error criteria is the six poles one zero model, although 
any model in the range from four to six poles (and even 
the third-order model) give small values of the error 
criteria . 

c. As the order of the model is increased the 
locations of optimum poles values approaches the real 
values. Since the error criterion remains almost the same 
in the range from four to six poles, the poles located far 
away contribute very little to the general transient re- 
sponse (performance of the system) . 

d. If it is desired to represent the system by a 
specific order model, the tables indicate the cost paid 
for the simplicity. Similar tables can be constructed for 
any specific problem. 

E . EXAMPLE IV 
1 . General 

It was decided to select the model of a real physical 
system in order to continue the investigation of the reduced 
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Figure III. 39. EXAMPLE III. System's response (A) and the 

Two Poles no Zero model's 
response (B) to a unit step 
input. 
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Figure III. 40. EXAMPLE III. System's response (A) and the 

Three Poles no Zero model's 
response (B) to a unit step 
input . 
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0 . 2 . 4 . 6 . 8 . 10 . 12 . 



Figure III. 41. EXAMPLE III. System's response (A) and the 

Five Poles no Zero model's 
response (B) to a unit step 
input . 
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Figure III. 42. EXAMPLE III. System's response (A) and the 

Six Poles no Zero model's 
response (B) to a unit step 
input . 
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Figure III. 43. EXAMPLE III. System’s response (A) and the 

Three Poles and One Zero 
model's response (B) to a 
unit step input. 
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Figure III. 44. EXAMPLE III. System's response (A) and the 

Five Poles and One Zero model ' s 
response (B) to a unit step 
input. 
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Figure III. 45. EXAMPLE III. System's response (A) and the 

Three Poles and Two Zeros 
model's response (B) to a unit 
step input. 
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OUTPUT 



1*4 




Figure III. 46. EXAMPLE III. System's response (A) and the 

Four Poles and Two Zeros 
model's response (B) to a 
unit step input. 
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OUTPUT 



1.4 




Figure III. 47. EXAMPLE III. System's response (A) and the 

• Five Poles and Two Zeros 
model's response (B) to a 
unit step input. 
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Figure III. 48. EXAMPLE III. System's response (A) and the 

Six Poles and Two Zeros model's 
response (B) to a unit step 
input . 
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Figure III. 49. EXAMPLE III. System's response (A) and the 

Four Poles and Three Zeros 
model's response (B) to a 
unit step input. 



9.4 



models for the given system. The system chosen was one 
representing the control system of the pitch rate of a 
supersonic aircraft, and was taken from Sinha and others 
[2] . Sinha selects the variable parameters in the system 
block diagram for reasonable pole-zero locations, con- 
sistent with design description and system stability. 

With these parameters, the transfer function of the test 
system is given by 

Y ( s ) 375000 (s+0. 08333) 

=G ( s ) 

R(s) s 7 +83.64s 6 + 4092s 5 +70 342s 4 +8537 0s j5 +2 814 271 s 2 

. .3310875S+281250 (III. 19) 

The roots of the characteristic polynomial are 
-0.092 ; -2.024±j0 .965 ; -7 . 675± j 13 . 445 ; -32 . 065± j 38 . 863 

The response of this system to a unit step was 
simulated and computed from 0 to 21 seconds and 700 samples 
(at intervals of 0.03 seconds) were used for the determin- 
ation of all possible 1^ -order models (2<£<6) with "m" 
zeros (0<m<3) , by the same technique and minimizing the 
error criteria function defined in Chapter II. B as the in- 
tegral of the squares of the output errors with no error 
in steady-state (constraint imposed) response to step input. 

The main features of the step response are given 



below : 

Time to reach first overshoot 2.9 seconds 

Maximum overshoot 8.6% 

Steady state value 0.111 

Response at maximum overshoot 0.12057 

Rise time 1 second 
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Because the step-response of the system has over- 
shoot a pair of conjugate poles and (£-2) real poles were 
specified for the different models. 

The simple second-order model was determined as an 
approach for starting the study. The state equations of 
the model are 

x-i (t) = x 0 (t) ; x-,(0)=0 

„ (III. 21) 

X2(t) = l.-a^x^t) - 2a^a2X2(t) ; X2(0)=0 

where the free parameters and a 2 represent the damping 
ratio and the natural frequency. 

The output of the model is 

y r (t) = Kx x (t) (III. 22) 

From Eq . (III. 19) the state equations of the system 
can be written 





0 1 0 0 




0 


x(t) = 


0 0 1 0 

• • • 


•x(t) + 


0 

• 




• • • 




• 




[j a l -a 2 _a 3 -a 7J 




1 



y_(t) = K CO . 0 833 1 0 . . 03 . x ( t) 



r ( t ) 



(III. 23) 



From the step response of second-order linear system with no 
zeros and taking into account the features given in Eq. 

(III. 20) , good starting parameter values were selected as: 
otj_ = C = 0 . 7 

a 2 = W N “2.5 (III. 24) 

t^ = 21 seconds 
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A performance index which is a function of the 
deviation between the output of both system and model, is 
defined as in Chapter II. B. Minimization of this cost 
function with respect to and yields the "best" second- 
order model. 

Equations (III. 21) and (III. 23) are integrated with 
respect to time to calculate the value of the error criterion 
at each step of the minimization process. The integration 
step size is chosen as 0.03 seconds, the same sample in- 
terval of the system. The same criterion on the Bode gain, 
steady-state error and starting parameter boundaries with 
flexibility to change them yields the results tabulated in 
Table III. 16. The transfer function of the second-order 
model becomes: 

0.36886 

G r (s) = (III. 25) 

s 2 +2. 3322 s+3. 3197 

and the pole locations: -1.1661 ± jl.424. 

After the above second-order model was determined 
the various models of third, fourth, fifth and sixth orders 
were obtained. The errors produced by the various models 
are shown in Table III. 20 and are plotted in Fig. III. 50. 

For further comparison between the reduced models a complete 
list of the optimum parameter values are tabulated in 
Tables III. 16 to III. 19. 

Step responses of some models and the actual system 
are shown in Figs. III. 51 to III. 5 8 on identical time scales. 
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'N s Poles 

ZerosS. 
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4 


5 
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0 




4.7 


4.6 


4.6 


4.9 


5.1 


1 




4.6 


2.7 


2.5 


3. 


2.7 


2 






4.7 


3.1 


2.9 


2.48 


3 








2.7 


2.59 


2.1 



TABLE III. 20. Error criterion (JxlO^) for various 

models in Example IV. 

It will be seen that most of the step responses of 
the determined models are not a good approximation to the 
true response of the tested system. Larger overshoot and 
smaller settling time can be observed and a singular fact 
can be pointed out from the step response figures: the 
decaying part of the transient response was not achieved 
by the determined models having only a pair of complex 
conjugate poles and the others (£-2) poles restricted to 
be real. It is clear that the actual system has a small 
real pole which has not been identified. 

Looking at Tables III. 16 to III. 19 is noticed that 
the third pole (first real pole) of the different models 
is always greater than 5.2, no optimum value less than this 
value is obtained. The selected system has a real pole 
very close to the origin, p^ = 0.092, and also has one zero, 
z^ = 0.0833. It was thought that the effect on the transient 
response of this zero and pole would be minimum due to the 
fact that they are close together and the zero might cancel 
the residue at the pole so that the contribution to the 
step-response would be negligible. Actually the pole close 
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JxlO 4 




Figure III. 50. Error criterion versus number of poles 

for Example IV. 
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TABLE III. 16. EXAMPLE IV. Optimum models with no 

zeros . 
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TABLE III. 17.- EXAMPLE IV. Optimum models with one 

zero . 
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TABLE III. 18. EXAMPLE IV. Optimum models 

with two zeros. 
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TABLE III. 19. EXAMPLE IV. Optimum models with 

three zeros. 
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Figure III. 51. EXAMPLE IV. System's response (A) and the 

Two Poles no Zero model's 
response (B) to a unit step 
input . 
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Figure III. 52. EXAMPLE IV. System's response 

Two Poles and One 
response (B) to a 
input . 



TIKE 



25. 

(A) and the 
Zero model ' s 
unit step 
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Figure III. 53. EXAMPLE IV. System's response (A) and the 

Three Poles no Zero model's 
response (B) to a unit step 
input. 
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Figure III. 54. EXAMPLE IV. System's response (A) and the 

Three Poles and One Zero model's 
response (B) to a unit step 
input . 



105 




Figure III. 55. EXAMPLE IV. System's response (A) and the 

Four Poles and no Zero model's 
response (B) to a unit step 
input . 
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Figure III. 56. EXAMPLE IV. System's response (A) and the 

Four Poles and One Zero model's 
response (B) to a unit step 
input . 
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Figure III. 57. EXAMPLE IV. System's response (A) and the 

Four Poles and Two Zeros model's 
response (B) to a unit step 
input . 
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Figure III. 58. EXAMPLE IV. System's response (A) and the 

Five Poles and Three Zeros 
model's response (B) to a unit 
step input. 
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to the origin appears to maintain its predominat effect 
mainly in the decaying part of the transient response and 
for that the determined models are not a good approximation. 

It was decided to impose on the program a constraint 
on the possible values of the third real pole in order to 
maintain its value in the proximity of the original system's 
value . 

The investigation of the reduced models for the con- 
trol system of the pitch rate of a supersonic aircraft was 
then repeated. 

The various models of second, third and fourth orders 
were obtained by the same technique as previous runs, using 
the same initial values for the complex poles. Besides 
constraining the third pole value to stay in the vicinity 
of its original value, in the models with one or more zeros 
a similar constraint was also imposed on the first zero 
value . 

The optimum parameter values of the various new 
models obtained and the corresponding values of the perfor- 
mance index are shown in Table III. 21. Step-responses of 
both original and lower order models are shown in Figs. 

III. 59 to III. 65. 

It is worth noticing that the new models determined 
are much better approximations to the true system than the 
previous models . The cost function values are smaller and 
the third pole is close to the origin. 

As a final checking of the necessity of constraining 
also the first zero in the minimization program in order to 
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TABLE III. 21. EXAMPLE IV. New models 




Figure III. 59. EXAMPLE IV. System's response (A) and the 

Two Poles and One Zero model ' s 
response (B) to a unit step 
input . 
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Figure III. 60. EXAMPLE IV. System's response (A) and the 

Three Poles and One Zero model's 
response (B) to a unit step 
input . 
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I 




Figure III. 61. EXAMPLE IV. System's response (A) and the 

Three Poles and Two Zeros model's 
response (B) to a unit step input. 
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Figure III. 62. EXAMPLE IV. System's response (A) and the 

Four Poles and One Zero model's 
response (B) to a unit step 
input. 
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Figure III. 63. EXAMPLE IV. System's response (A) and the 

Four Poles and Two Zeros model ' s 
response (B) to a unit step 
input . 
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Figure III. 64. EXAMPLE IV. System's response (A) and the 

Four Poles and Three Zeros 
model's response (B) to a 
unit step input. 
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Figure III. 65. EXAMPLE IV. System's response (A) and the 

Seven Poles and One Zero 
model's response (B) to a 
unit step input. 



118 



maintain its value in the proximity of the original system's 
value a new run was done. A new three poles and one zero 
model was determined setting constraint on the small pole 
but not on the small zero. 

The optimum parameter values of the new model were: 



New Model 


Pi 


P2 


P3 


Z 1 


JxlO 4 


3 Poles 
1 Zero 


1 . 8+ j 0 . 84 


1.8-jO. 84 


.094 


.085 


.09 



which compared with the model obtained constraining both 
small pole and small zero (see Table III. 21) does not appear 
to be much different. No constraint seems to be necessary 
on the small zero. Only seems mandatory to impose a con- 
straint on the small pole upper bound because the decaying 
part of the system's transient response. 

2 . Remarks 

Looking at the results the following comments should 
be noted: 

a. The error criterion (J) value at Table III. 20 
are of the same order as the ones in Table III. 5 (Example I) 
but the models are not a good approximation. The values of 
(J) at Table III. 21 are much smaller and the models are a 
good approximation. It can be deduced that the cost function 
(J) is related mainly to the steady state final value which 
in Example I was 1.0 and in this example is 0.111. Selection 
of the desired model can be done taking into account this 
fact . 
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b. The second-order model still is worst and does 



not appear to be suitable. 

c. The third and fourth order models with zeros 
achieve a very acceptable error criterion value. 

d. A model which gives a minimum value of the per- 
formance index (J) is the four poles one zero model, al- 
though the three poles one zero and four poles two zeros 
give small value of (J) . Again a "best" optimum model seems 
suitable . 

e. The complex root values for the various models 
remain in a very small area. The first real pole and the 
first real zero remain in the proximity of the original ones. 
The system has one pole and one zero very close to the 
origin. It seems that in the cases in which the high-order 
system has singularities very close to the origin it is 
necessary to keep them in the low-order models. 

f. Selection of the desired model can be done for 
specific required approximation depending on the desired 
simplicity, looking at the transient responses of both 
(original and approximated) and weighting the cost function 
values (J) . 

g. The starting second-order model assumed gives 
good starting parameter values for the derivation of in- 
creasing order models. 
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IV. CONCLUSIONS 



The investigation presented can be considered as another 
approach to find the best low-order linear constant system 
which approximates the given high-order system. 

It is based on the exhaustive use of the computer to 
estimate the free parameters which locate the roots of the 
model for which the integral of the squares of the errors 
is minimized. (The error is defined to be the difference 
between the response of the actual system and that of the 
model. The integral is evaluated between 0 and a selected 
final time.) 

The description of the actual system dynamics need not 
necessarly be known. The case has been investigated in 
which the input-output data measured at discrete instants 
of time is known. 

In Chapter III four examples were investigated to de- 
termine all the optimum models whose order varies from the 
second-order with no finite zeros to seventh-order with 
three real zeros. A complete set of graphs showing the 
variation of the error criteria value with respect to the 
number of zeros and poles of the model and all different 
pole and zero locations on the s-plane of the models were 
determined . 

The variety of tables and figures has been obtained to 
enable the analyst and/or engineer to make a rapid and 
suitable choice of the order of the model weighting the 



121 



cost function (J) . An analysis has been presented for 
evaluating the effects of such attempts in the various 
transient responses. It is felt that a new insight has been 
gained in the cost paid for the simplicity of the model and 
in the accuracy of the transient response of the model re- 
lated to the numerical value of the error criterion, in 
order to get an acceptable response. 

The following remarks can be stated: 

1. The most common methods of modeling higher-order 
systems by making a second-order model approximation do not 
appear to be suitable for an error criterion value which 
give acceptable approximation according to the simplicity 
of the model. 

With at least three poles and one zero models can be 
obtained which give a very good approximation. 

2 . A good approach for starting the study when the 
step-response of the system has an overshoot, was the de- 
termination of a pair of complex roots for the model derived 
from the curves of the step response of second-order linear 
system. To do this one takes into account the most common 
features of the step-response of the system. 

When the transient response of the system shows the 
existence of a pole close to the origin, it appears to be 
mandatory to keep this singularity also in the lower order 
model. 

3. It is possible, in effect, to weight the desired 
simplicity of the model versus selected error criterion 
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value. A "best" optimum low-order model which gives the 
minimum of all cost function values seems feasible. 

4. The cost function value drops down very fast achiev- 
ing a very acceptable value after the third or fourth order 
models are obtained. Then as the order of the model is in- 
creased the error criterion value varies very little and 
remains almost unchanged. So adding poles to the model - 
increasing its complexity or losing its simplicity - is not 
going to minimize the cost function value which remains in 

a very small area, i.e., the magnitude of the cost is 
essentially unchanged by the addition of poles and zeros, 
and furthermore keeps a very acceptable value . 

Increasing the order of the model is not justified by 
the results because the price paid is high in comparison with 
the small improvement in the error criterion value. Under 
such circumstances the third or fourth order models seems to 
accomplish the characteristics of a good model. The decision 
in the choice of the reduced approximated model is done more 
easily knowing this fact in the cases in which limitations 
on the maximum order of the model or sufficiency of the 
resultant error (J) are real constraints. 

5. The computer subroutine optimizes the selected model 
with respect to a specific error criterion. The user has to 
give the starting parameter values and it was seen how 
fundamental is this selection of values to achieve the 
optimum minimum error criterion. Limitations arise from 
this fact and from the convergence properties of the 
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algorithm which this subroutine uses. Improvement in 
efficiency should be possible by using a minimization 
program with known good convergence properties. 

6. In Example IV was noted that in all cases the small 
pole and small zero did not go to the constraint limit, but 
they found a value within the constrained range. This seems 
to indicate that a local minimum does exist but was missed 
in the unconstrained searchs , probably because the minimiza- 
tion program used too large an increment. 

As was stated in point 5, a good computer program will 
improve largely the efficiency of the search of the model. 
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SAMPLE PROGRAM FOR EXAMPLE 
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